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ABSTRACT 

: An experiment was conducted toMest the interaction 

of intelligence quotient (IQ) and achievement lerd with practice on 
programed learning materials* Two hypotheses were proposed; (1) 
learning jperformance of high IQ and' high achievement level groups 
would he equivalent regardless of differences in anourit of prior 
practice on a new learning task, and (2) performance would improve 
with practice for average intelligence and achieveient groups. Some^ 
120 junior high school students, who* had never used programed 
learning materials, were divided into two groups matched on IQ test 
and achievement test scores. Three chapters^^Fom a linear program in 
general science were presented in alter np^feorder to the two groups. 
Scores on the multiple choice chapter test given after the first 
chapter exposure for group one and after the third exposure for group 
two Here coiapared* The difference in test scores for the high IQ dnd 
hiah achievement students was not significant* The difference was not 
significatot for the average IQ groups but nas significant for the 
average achievement groups* (KB) ^ 
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ABSTRACT 

Two different orders of three units of programed ini^ruction were admin- 
istered to groups of students matched on (a) intelligence ^or (b) relevant 
achievement tests. Comparisons were made between groups that were (a) 
high .or (b) average on each matching variable. The hypotheses being tested 
Were that after varied amounts of prior practice in programed instiuction, (a) 
learfiing set formation would not be demonstrated by the high intelligence and 
high achievement groups, and (b) learning set formation would be demonstrated 
by the average intelligence and average achievement groups. Only partial 
support was obtained for each hypothesis. The data indicated the following: 

(a) In a programed sequence, error rate is a more appropriate 
measure than achievement for observing learning set 
formation. 

(b) Learning set formation is observable in programed instruction 
for all learners regardless of individual differences* Since, 
reduced error rate was the indication of learning set formation, 
the phenomenon can be measured only in programs involving a 
moderately high error rate. 

(c) Since error rate differed for some of the experimental groups 
while achievement remained the same, the results were in- 
terpreted to mean that a moderately high error rate program 
which offers opportunity for correction of response errors may 
be as effective in producing learning as a low error rate^ 
program which confirms correct responses* 
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SECTION I 
INTRODUCTION 

Harlow (ref 1) has shown that lower organisms Improve In learning, efficiency as 
they gain experience In responding to prc4>lem-solvlng tasks. In these tasks, 
the" learner is prese'tited with a series of small problems one at a time. The suc- 
cessive problems vary In content, but the set of operations required to find and 
make the correct response Is the same for each, eg, differentiating shape and 
position of objects, making a second response choice dependent upon the first 
choice, etc. On every problem, the response made by the organism Is immedi- 
ately confirmed if it is correct, reinforcing the operations that precede It. Under 
these conditions, the organism gradually develops proficiency In discriminating 
the cues within the problem that will lead to making successful responses. In 
the process, the organism not only leams the solutions to the Individual problems, 
but leams also how to perform the operations necessary for arriving at a solution. 
This increase In efficiency with continued practice in new learning situations has 
been called learning set formation. The phenomenon also has been observed In 
human subjects and different learning tasks (refs 2,3). . ^ 

Like the learning situations used by Harlow, programed instruction requires the 
leerner to make responses to a sequence of problems. Knowledge of the correct- 
ness of the response follows immediately after each response is made. Further, 
the operations employed in determining £he correct response often are similar for 
each item in the sequence presented, eg, the learner must attend to the information 
presented, discriminate the information-giving cues for the response required < and 
recall cues from preceding items that relate to the current Item to arrrive at the 
correct response. This similarity between the sequential aspects of many programed 
learning tasks and the sequential aspects of the tasks used in learning set studies 
suggests that human learners when exposed to the programed Instruction method for 
the first time may Initially show some degree of Inefficiency in utilizing the mate- 
rials presented, but with experience will learn the operations necessary for effec- 
tive and successful learning. Were this the case, the Increased learning proficien- 
cy would be reflected In progressively higher achievement as the learner gains 
experience with the new learning situation. 

The possibility that learning sets are formed with increased exposure to programed 
instruction sequences has been implied In Skinnnr's statement that the programing 
principle of immediate confirmation "encourages a more/careful reading of the pro- 
gramed material than is the case in studying a task where the consequences of 
attention or inattention are so long deferred that they have little effect on reading 
skills" (ref 4). The degree of improvement In attention and other behaviors neces- 
sary for learning will depend upon the extent to which these behaviors already exiSt. 
In the human organism, the development of learning skills that define learning set 
formation may be expected to vary with certain Individual differences that are assumed 
to be related to human learning In general. For example < one of the correlates of. ex" 
Istlng Intelligence measures that is usually assumed is the ease or speed with which 
the learner can adapt to new learning situations. If such a relationship between 
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intelligence and learning adaptability does exist, high aptitude learners should 
demonstrate learning set formation soon after they are introduced to a new learning 
situation, whereas those of lower aptitude should require more time to develop a 
learning set. 

A second variable possibly related to the ease wit^ which a learner adapts to 
a new learning situation Is the degree of prior knowledge of the material being 
taught. The learning situation Is made up of two components in addition to the 
learner — the material to be learned, and the instructional conditions under which 
the learning is to take place. The learner having some prior familiarity with the 
material presented may adapt more readily to a new learning situation than the one 
who either has no familiarity with the material or has b^en unsuccessful in learn- 
ing similar matehal in the past. Previous stud*ies of learning set, using lower 
organisms, .have controlled the effects of prior knowledge by Rising learning ma- ^ 
t^rials which are jcompletely unfamiliar to the animal. In most human learning" 
situations, however, such control methods are more difficult to implement. The 
alternative is to manipulate prior relevant knowledge rather than eliminate it. 

The experiment reported here was an exploratory effort to observe learning set 
formation in human learners erased to programed instruction. We hypothesized 
that (a) learners of high intelligence and prior school achievement would not dem- 
onstrate differences in achievement and response accuracy as practice learning 
from programed instruction accrued, but that (b) learners of average intelligence 
and average prior school achievement would demonstrate improvements in achieve- 
ment and response accuracy with increased practice in programed instruction. 



SECTION II 
METHOD 



SUBJECTS 

The subjects used were inatched groups drawn from a pool of 120 junior high 
school students receiving programed instruction in science. None of the 120 
students f and. consequently none ofithe experimental subjects, had been ex- 
posed to programed instruction prior to the experiment. Therefore* learning 
by programed instruction methods was considered to be a new learning situ--^ 
ation for all subjects. , 

MATERIALS ^ ^ " 

Three \:hapters from a linear program on General Science^ were use j as learning 
materials. The chapters, covering independent science topics commonly taught 
in junior high school, were Measurement (235 frames), Chemistry (825 framed), 
and Sound (230 frames). These were presented in a programed textbook format 
that required the learner to read the frame, write down one or more responses , 
turn the"^ge and confirm the correctness of the resporise(s)# and then proceed 
to the next frame. Students were permitted to respond at their own rates of speed 
in as many 40-minute work sessions as were necessary to complete the three 
chapters. 



The Otis Test of Mental Ability (Beta) and the Cooperative Science Achievement 
Test were used as measures of intelligence and prior knowledge of the learning 
material, the two independent variables assumed to be related to learning set 
formation. 

At the end of each-chapter all learners received a multiple-choice test which had 
been constructed specifically for that unit. Scores on these chapter tests were 
used as measures of the amount of learning that took place during the programed 
instruction. 

DESIGN AND PROCEDURE 

Before the experiment, measures of intelligence and prior science knowledge 
were obtained for 120 students in the classes from which the experimental 
subjects were drawn. These two measures served as the basis for establish- 
ing high and low matched experimental groups. 



1. Published commercially in three volumes as "General Science*' by Teaching 
Materials Incorporated, Division of Gralier, Inc. * 575 Lexington Avenue, 
New York 22, N.Y. 
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In the learning phase, two of the four classes cxDntaining the experimental 
subjects jeceived the Measurement chapter first, followed by the Chemistry 
and Sound chapters (Order 1). The remaining two classes received the same 
units # but in the reverse order (Order 2). These presentation orders are sum- 
marised in table I. Groups matched on intelligence le^vel and groups matched 
r)n prior science achievement level were selected from each presentation order, 
and compared On two learning measures- Arrows indicate the comparisons that 
bear upon the experimental hypotheses.^ 

TABL'E I . * 

SUMMARY OF PRESENTATION ORDERS 



Order 1 
(H-IQj and L-IQ^) 



1 . Measurement 

2. Chemistry < 

3 . Sound ^ 



Order 2 
(H-IO2 and L-IO2) 



1 . Sounds 



2 . Chemistry 

3 . Measurement 



The selection procedures for the groups, and the comparisons made in testing the 
hypotheses, are described below- 

1. Design for Groups Matched On Intelligence . Of the 60 subjects who re- 
ceived Order 1 , the 15 with the highest scores on the intelligence test and the 
15 with the lowest scores were selected as expeiimental subjects. These groups 
were designated H-IQ^ and L-IQ^, respectively. From the 60 students in the 
Order 2 classes, 15 high Intelligence subjects (H-IQg) and 15 lower intelligence 
subjects (L-IQg) were matched by pairing with the experimental subjects chosen 
frcm Order 1 . 



As may be seen in Table 1, the Measurement chapter constituted the initial 
exposure of H-IQ^ to the new programed learning situation, while H^IQ^ received 
this chapter after prior practice with the Sound and Chemistry programea sequences 



2. This design is predicated upon minimum differential transfer among the 

subject-matter areas. Interpretation of the comp^^sons would be made more 
difficult if the study of chemistry were to benefit the study of measurement 
more than the study of sound, or vice versa; A similar difficulty vi/ould be 
encountered if, for some reason, it were better to study measurement before 
sounds or vice versa. The subject matters used in the study were consid- 
ered to be relatively free from such differential transfer effects. 
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These groups were used to test the first hypothesis # which predicted that thd^ 
learning performance of high intelligence groups would be equivalent regardless 
of differences in prior practice in a new learning situation. The test of this 
hypothesis was made by comparing H-IQ^ and H-IO2 on two criterion measures 
of learning performance # chapter test achievement and frame error rste, for the 
Measurement chapter. 

Table 1 indicates also that the L-IQ^ and L-IO2 groups received the Moasurement 
chapter^fter different amounts of practice in the programed learning situation. 
These groups were used to test the second hypothesis, which predicted that the 
louver Intelligence group receiving prior practice th programing {L^I02) would dem^ 
onstrate hlgheV performance than the group receiving no such practice (L^IQ^). The 
dependent variables on which these groups were compared were also the chapter 
test and frame error rate* 

The design permitted a replication of these tests of the hypotheses by using the 
^ Sound chapter as the learning material presented with or without prior practice In 
the programed learning situation. Using the Sound chapter test as the achievement 
measure and frame errors in the Sound chapter as the error rate mea'sure. It was 
predicted that no differences between the H-IQ^ and H-IO2 groups would be found, 
but that L-IQj would show a higher performance than L":I02 on both measures * be- 
cause of the practice received prior to working on the Sound unit. 

2. Design for Groups Matched on Achievement. Matched groups with high 

and lower achievement scores were also chosen from the pool of learners 'who had 

taken Order 1 and Order 2. The Cooperative Science Test score was used as the 

criterion for group placement. The four groups thus chosen were designated L-Ach^, 

H-Ach, f and L-Ach^, and H-Ach^# with 15 subjects In each group. 

1 ^ ^ . [ 

These achievement groups were subjected to the same comparisons as dJscrlbed 
above for the Intelligence groups. The procedure for selecting subjects allowed a 
given subject to be in one of the achievement groups and also In one- of the Intel^ 
llgence groups, eg, hl*jh achievement and high Intelligence. 
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SECTION III 



RESULTS 



.ACHIEVEMENT MEASURES 

The data obtained from the four matched lO groups on the Measurement and 
Sound chapter tests are presented in table II- Correlated J, tests of differences 
between H-IQj and H-IQ2 means for the measurement and Sound chapter tests 
yielded values of 1.49 and 1.12, respectively. TKese values indicate that the 
obtained mean differences are well within the llniits of chance* Thus, there is 
no basis to refute the first hypothesis that high intelligence groups would learn ^ 
to equivalent degrees regardless of differences in amount of prior practice with 
programed instruction. 

To test the second hypothesis, that prior practice in the new learning situation 
would increase achievement performance of learners of average intelligence, 
L-IQj and L-IQ2 mean^ on the Measurement and Sound chapter tests were com- 
pared. Again, correlated _tt^ts-^ITfiJxcated that the differences were not statis- 
tically significant ( t = 1. 36 for Measurement and 1*49 for Sound)* The differ- 
ence on the Sound test was in the opposite direction from that predicted. Thus, 
the data do not support the second hypothesis. 

The Measurement and Sound test means of the groups matched on prior science 
achievement were also usled to test the hypotheses. Table ni presents mean 
scores on both tests for t/ie H-Achj , H-Achg/ L-Achj, and L-Ach2 groups. The 
mean differences between H-Achi and H-Ach2 were not significant ( t = 0.87 and 
0.98 for Measurement and Sound/ respectively), again offering no ba^is to refute 
the first hypothesis* Th^ difference between LTAchj and L-Ach2 means on the 
Measurement test was significant in the direction predicted by the second hypoth- 
esis ( t = 3.41; df/14; P <.0l). The mean di^fwence between these groups on the 
Sound test, however, was significant in the opposite direction froni that predicted 
( t = 2*70; df/14; P < .02). ^ 

* 

In an effort to account for the contradictory results obtained from the L-Ach groups , 
the means of all groups on the Chemistry chapter test were compared. Since the 
Chemistry chapter was received by each group after equivalent practice in the new 
learning situation, no differences between the matched sets of groups should be 
found if the matching procedures were adequate. A series of correlated J, tests 
revealed no differences in Chemistry achievemer large, enough to reach signifi- 
cance for the H-IQ, and H-IQ2, the H-Achj and H-Achg, and the L-IQj and L-IQ2/ 
matched groups. However, the Chemistry mean score of L-Ach^^ was significantly - 
- higheV than the L-Achj group with which it was matched f t = 2*65; df/l4; P <*^I5). 
Apparently the 'latter two groups, although matched on a measure of prior science 
Knowledge, were not equivalent in learning ability. The significantly higher per- 
formance of L-Ach2 on both the Measurement and Sound chapter tests was probably 



E RslC . 



10 



due to this inadequacy in matching, rather than to the experimental treatments 
received* Because L-Achg was significantly higher than L-Achj on all three 
program achievement tests, comparisons of these groups must be considered 
inappropriate for testing the second hypothesis. 



TABLE n 

MEANS AND STANDARD DEVIATIONS ON IQ AND THE MEASUREMENT 
AND SOUND CHAPTER TESTS FOR HIGH AND LOWER MATCHED 
INTELUGENCE GROUPS RECEIVING ORDERS 1 AND 2 



Groups 


1 


1 

IQ 




Measurement* 




Sound* 


1 

1 




Received 
First 


Received 
Last 




Received 
First 


Received 
Last 


H-IQj 


M 




123.07 




20.93 








22.07 


SD 




3.48 




7.19 








6.24 


H-IO2 


M 
SD 




123.87 
4.03 






23.93 
4.68 




24*00 

4.44 




L-IQj 


M 




101.13 ' 




11.60 








14.20 


SD 




3.79 




4.58 








5.82 


L-IO2 


M 
SD 




^ 102.07 
3.17 






14.53 
5.42 




15.40 
3.42 

c 





* Perfect score = 30* 
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TABLE III 



MEANS AND STANDARD DEVIATIONS ON PRIOR SQENCE ACHIEVEMENT 

AND THE MEASUREMENT AND SOUND CHAPTER TESTS FOR 
HIGH AND LOWER ACHIEVEMENT GROUPS RECEIVING ORDERS 1 AND 2 
4 



Groups 



Prior 
Achievement 



Measurement 



Received 
First 



Received 
Ust 



Sound 



Received 
First 



Received 
Last 



H-Adi 



1 



H-Ach, 



M 
-«D 

M 
SD 



82.87 
12.60 
81.93 
13.07 



21.53 
4.52 



23.07 
5.62 



23.53^ 
3.80 



22.40 
3.60 



L-Ach 



1 



L-Ach, 



M 
SD 

M 
SD 



49.07 
6.83 

49.00 
6.77 



10.13 
4.12 



15.87 
5.29 



15.73 
4.59 



12.60 
4.97 



ERROR RATE MEASURE 

The proportions of errors made in the Measuremen\ and Sound program chapters 
were calculated for all subjects by finding the numbeKof errors the subject made 
in the chapter and dividing by the total number of frames . Mean error proportions 
were then calculated for each group ih both the matched intelligence and the match- 
ed achievement categories, and comparisons of these i^iean error proportions were 
made to test the hypotheses . Since error rate data jvas not available for all sub- 
jects, from one to four matched pairs had to be eliminated in. making some of the 
comparisons. The decreased N's resulting from these eliminations are reflected 
in the varying degrees of freedom of the correlated Jt tests reported below. 

Table IV presents the mean error proportions of the high and lower matched achieve- 
ment groups taking the Measurement and Sound chapters either first or last in the 
instruction sequence. Comparisons of the H-Achj^ and H-Ach2 groups showed that 
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the- error difference on the Sound chapter was not significant ( t " 1.98; df/l4; 
P > .05). However, tjte difference between the high groups ^on the Measurement 
chapter is significant at the .05 level ( t = 2.43; df/ll), contradicting the hy- 
pothesis that the matched high groups would show equivalent response accuracy 
regardless of variation in amount of prior learning practice. 

Differences in mean error rate between the L-Achj^ and L-Achg groups were sig- 
nificant for both the Measurement chapter ( t = 4.86; df/U; P <.002) and the 
Sound chapter { t " 2.89, <if/ll; P.<.02), The latter difference was in the oppo- 
site direction from that predicted. As indicated previously* however* differences 
between the L-Ach groups may be due to factors other than the experimental treat- 
ments, and cannot Jbe considered as adequate tests of the second hypothesis. 

Mean error proportions of the high and lower matched IQ groups on the Measure- 
ment and^oUhd chapters are presented in table IV. As was found for the high 
achievement groups^ the difference in error rate between H-IQ, and H-IQg was 
significant on the Measurement chapter ( t == 2.83; df/12; P < ."02) again contra- 
dicting the first hypothesis. Error rate differences between the high groups on 
the Sound chapter did not differ significantly ( t = 1.95; df/l2). F't the lower 
intelligence groups, the difference in error proportion on the Measurement chap- 
ter was significant (t - 2.26; df/lO; P < .05), in the direction predicted by the 
second hypothesis. The error rate difference between L-IQj^ and L-IQ^ on the 
Sound chapter was in the opposite direction from prediction, but not significant 
(t = 1.26; df/u). * ^ • . 



TABLE IV 

MEASUREMENT AND SOUND ERROR RATE MEAN OF HIGH- AND LOWER 
MATCHED ACHIEVEMENT GROUPS RECEIVING ORDERS 1 AND 2 



' Mean Proportion of Errors*^^ 



Groups 


Measurement 


Sound 


Received 
First 


Received 
Last 


Received 
First 


Received 
llbst 


,H-Ach^- 
H-Ach^ 


.13 






.08 " 


.07 


.04 




L-Achj 
L-Ach2 


.26' 
' 1 


.08 


.10' 


.15 " 
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TABLE V 

MEASUREMENT AND SOUND ERROR RATE MEANS OP HIGH AND' LOWER 
MATCHED INTELUGENCE GROUPS RECEIVING ORDERS 1 AND 2 



/ 



Mean Proportion of Brors 



/ 



Groups 


Measurement 




Sound ' 


Received 
First 


Received 
Last 




Received 
First 


Received 
Last 


H-IO^ 
H-IO2 


ai 


.09 




.04 


.07 


L-IO^ 
L-IO2 


.23' 


.13 




.10 


.13 



■ 6 



14 

10 
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SECTION IV 
DISCUSSION 

The prediction that differences on the achievement and error proportion meas- 
ures would not occur between the high groups In the different orders was sup^ 
ported in six of the eight analyses made. The two contradictions occurred 
when error proportions on the Measurement chapter were compared, indicating 
that both the high intelligence group and the high achievement group recpivlng 
Order 2 made significantly fewer frame errors thai^^he high groups receding 
Order 1, Although these differences con^xadict the first hypothesis, the direc- 
tions of the differences were consistent with that predicted for the lower groups 
by the second hypothesis. This consistency ^suggests that some learning set 
formation occurred for the high groups in the Measurement chapter, and that 
error rate was the only measure sensitive enough to shojw it. For the original 
hypothesis made concerning high-group performance, therefore, the data indi- 
cate just partial confirmation. 

The second hypothesis, that learners of average Intelligence and average prior 
school achievement would demonstrate Increased learning performance as prior 
practice In the new learning situation Increased, was also tested in eight sepa- 
rate analyses . Four of the^e analyses were considered* Inconclusive because 
bt^data Indicating that the L-Achj and L-'Ach2 groups were not matched in terms 
of learning ability. Of the remaining four tests made, one supported the second 
hypothesis. The supporting analysis occurred when the error rate of the L-IQj 
and L-IQj> groups were compared in the Measurement chapter. This analysis 
showed that the groups receiving Measurement after prior practice with pro- 
gramed instruction made significantly fewer errors than Its matched group, 
which had no such prior practice. 

Although the two hypotheses originally tested received only partial confirmation, 
there are certain consistencies in the results that Imply alternative hypotheses 
about learning set formation In programed Instruction. First, significant differ- 
ences between the matched groups, whether confirming or dlsconflrmlng*a hypoth- 
esis, were found only for error rate. &i contrast, achievement on the chapter 
tests remained equivalent for the matched groups regardless of the treatment to 
which they had been exposed. These data fall tc establish that differences In 
amount of practice In programed instruction have any effect upon achievement, 
although error rate In certain cases was significantly affected. 

Some negative results were obtained even though error rate was used as the cri- 
terion measure.. To understand the reason for these letter dls confirmations / an- 
other consistency found In the data must be clarified — le, that in all cases 
where differences In error rate were found, whether ^fhe difference was confirming 
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or not, the progranj being analyzed was the Measurem^t chapter. No error 
rate differences between matched groups were found In the Sound chapter. 

The consistent restriction of error differences to the Measurement chapter in- 
dicates that the two chapters used In testing the hypotheses were different In 
some way with respect to the responses required. Inspection of the error rate 
data reveals that error rate proportions were low for the Sound chapter (ranging 
from .04 to .15), regardless of when that chapter was given, while the Meas- 
urement chapter error rates were generally higher (ranging from .05 to .26), 
particularly If that chapter was the first programed Instruction the subjects re- 
ceived. The response task was generally more difficult for the latter chapter. 
Apparently the reason that error rate differences were found only for the Meas- 
urement program was that the learning trials (frames) In that chapter were diffi- 
cult enough to permit Improvement with practice, while those In the Sound 
chapter were less difficult so that the error rate was low regardless of prior 
practice. The analogy to the studies of learning set formation seems clear — 
the problem tasks presented must be difficult enough Initially so that Improve- 
ment can be measured. 

These Interpretations of the data permit the formulation of some alternative hy- 
potheses about the presence of learning set formation In programed Instruction. 
First, there are Indications that learning sets of the kind Identified by Harlow 
{le, continued practice results In a decreasing number of error trials to solution) 
do form as practice In programed Instruction accrues, but only under certain 
programing conditions. Learning set formation Is observable when the program 
used has frames which are sufficiently difficult to allow response accuracy to 
Improve. A second hypothesis suggested by these data Is that learning set for- 
mation win be observed In all learners receiving programs of moderate Intratrlal 
difficulty for the first time, regardless of Individual differences In Intelligence 
or prior learning success In other Instruction situations. This hypothesis, con- 
tradicting rather than merely restricting those originally posed. Is based upon 
the results from the present study showing that error rate on the Measurement 
chapter decreased significantly for the high groups as well as the lower groups. 

The results of the current study also have certain implications for the generally 
accepted rule that a low error rate is a necessary requirement for efficiently pro- 
ducing high achievement. In the present data, achievement scores on the Meas- 
urement chapter test w^re equivalent for the H-IO, the H-^^ch, and the L-IO 
matdied groups, even though significant differences in error rate were demon- 
strated for the two groups in each set. Similar evidence yas obtained in another 
Tecent-sttidy-(ref 5). One "explanation for this learning sijccess in spite of 
decreased confirmation Is that when incorrect frame resii^nses occur, the imme- 
diate feedback serves as. a correction trial. This explan^ttlon Implies that ter- 



3. Comparisons between i.*Ach groups are not consldei'ed because of demonstrated 



inequality In learning ability. 
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minal achievement in linear programing is not solely a function of the opportunity 
for immediate confirmation of correct responses, but rather that the frames of a 
program provide both confirmation of correct responses and correction for wrong 
responses, both of which contribute to producing the desired terminal behavior. 
If this explanation is coixect/ under certain conditions, correction is as effective 
as confirmation of correct responses in producing learning* 
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